Minimal Brownian Ratchet: An Exactly Solvable Model 
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We develop an analytically solvable three-state discrete-time minimal Brownian ratchet (MBR), 
where the transition probabilities between states are asymmetric. By solving the master equations we 
obtain the steady-state probabilities. Generally the steady-state solution does not display detailed 
balance, giving rise to an induced directional motion in the MBR. For a reduced two-dimensional 
parameter space we find the null-curve on which the net current vanishes and detailed balance holds. 
A system on this curve is said to be balanced. On the null-curve, an additional source of external 
random noise is introduced to show that a directional motion can be induced under the zero overall 
driving force. 

PACS numbers: 



The Brownian ratchet and pawl system was first cor- 
rectly explained by Smoluchowski 1] and later revisited 
by Feynman - this has inspired much activity in the 
area of Brownian ratchets, despite flaws in Feynman's 
analysis of the thermal efficiency of the ratchet engine |3| 
and detailed balance p|. 

Interest has revived because molecular motors have 
been described in terms of Brownian ratchet 0,01 mod- 
els. Another area of interest has been in Parrondo's para- 
dox where losing strategies cooperate to win. This can 
be illustrated in terms of games that lose when played 
individually, but win when alternated - this has been 
shown to be a discrete-time Brownian ratchet , other- 
wise known as a 'Parrondian game'. Parrondo's games 
have significantly sparked recent interest in the areas of 
lattice gas automata [kJ ,spin models [Tlj , ra ndom walks 
and diffusion s 112. Ha . Ill ], biogenesis iTal . molecular 
transpo rt fl6lll7ll . noise induced patterns |18| , stochastic 
control jl9i 1201 - stochastic resonance |2l| and quantum 
game theorvpa. l23| . Recently, Reimann [24| has per- 
formed an extensive review of the ratchet field. 
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Jarzynski et al. |25| developed an exactly solvable 
Brownian ratchet that can be operated as a heating sys- 
tem or refrigerator, depending on the parameters be- 
tween two heat reservoirs of different temperatures. How- 
ever this is treated as a six state system and solution is via 
matrix inversion of coupled linear equations. The deriva- 
tion is somewhat complex, so the physical picture and 
key ingredients of the observed properties are obscured. 

Westerhoff et al. pt| have analyzed enzyme transport 
using a four-state model. In this paper, for the first time, 
we develop a three-state discrete-time Brownian ratchet 
model that can be solved analytically. We call it the 
Minimal Brownian Ratchet (MBR) |27|. By setting up 
and solving the steady-state solution of the corresponding 
master equations we obtain the probability current and 
the null-surface, in the parameter space, of the noisy and 
noise-free MBR. The obtained solution does not show any 
critical behavior and can be suitably explained in terms 



FIG. 1: State-transition diagram of a 3-state discrete-time 
Brownian ratchet with asymmetric transition probabilities 
po, pi and p2 in the positive direction (counter-clockwise) 
and (1 — po), (1 — Pi) and (1 — p^) in the negative direc- 
tion (clockwise) . Each transition has two numbers associated 
with it, {pk,Rk}. The first number in the brackets, p%, is 
the conditional probability of that transition (given the ini- 
tial state). The second number, R^, is the reward associated 
with that transition. Note that we have a skip-free process, 
which means the reward structure is +1 for 'winning' transi- 
tions and —1 for 'losing' transitions. 



of non-singular behaviors. 

The minimal ingredients of a Brownian ratchet are an 
asymmetric potential and random noise. In Fig. ^ we 
show the state diagram of the MBR. The MBR has three 
states, {So, Si, S2}, where the transition probabilities be- 
tween states are asymmetric. The transition probability 
that a random walker in state Sk steps in the positive 
direction is pk ■ The probability of a shift in the negative 
direction is p~k- This is true for k e {0, 1,2}. We define 
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the positive direction as counterclockwise. The condition 
of normalization, Pk + P~k = 1, is automatically enforced 
by our choice of symbols. These ingredients comprise a 
three-state random walk model with generalized asym- 
metric potential and we call it a noise-free MBR. 

It is straight forward to set up the following difference 
equations for the probability distributions of the noise- 
free MBR model: 



P k (t + 1) = P k +l(t)p k+1 + Pk+2(t)Pk+2 



(1) 



for all cyclic (modulo-3) state indices k. Pk(t) is the 
probability for the random walker at time t to be on 
the state of Sk- This can be written in matrix form as 
Pt+i = Pt-B, where Pt is the time varying probability 
(row) vector at time t and B is the transition probability 
matrix. We can write: 



[Bi,j] = 



Po Po 
Pi pi 

P2 P~2 



The steady-state probability, after a sufficiently long 
time, linit^oo Pt = P is simply given as 



P = PB 



(2) 



which is a characteristic value problem. A partial prob- 
ability current, /, can be defined as 



I = PkPk - Pk+iPk+i- 



(3) 



If I = there is no net current and detailed balance |2jj 
is satisfied, otherwise there exists a net current and the 
system will assume a non-equilibrium steady-state. 

Solving the Eq. [21 together with the normalization con- 
dition, Pq + Pi +P2 — 1 , is again straightforward. Using 
the standard methods for characteristic value or eigen- 
value problems, we obtain 



Pk = (Pk+1 +Pk+lPk+2)/D 

for all k. The denominator D is given as 
D = 2 + popip 2 + PoP\P~2- 



(4) 



(5) 



These expressions are consistent with the results of 
Pearcc 29] . It is easy to check that they are the solution 
to Eq. [21 by direct substitution. 

We can substitute the results from Eqs.^linto Eq.|21to 
solve for the net current, /, 

I = (P0P1P2 - P0P1P2) / D . (6) 

The condition for detailed balance / = is then 



P0P1P2 = P0P1P2, 



(7) 



which is the equation of a two-dimensional surface in the 
three dimensional parameter space, {po,Pi,P2}- Note 
that the Eq. is independent of state index k as is re- 
quired by its definition given in Eq. |3J 



The second part of the MBR is to introduce additional 
random noise to the system. To the noise-free MBR, 
we add more noise, controlled by the parameter 7, to 
the MBR as follows. With a probability of 7, a random 
walker follows the dynamic rule of the noise-free MBR 
otherwise, with the probability of 7 (=1 — 7), the walker 
randomly takes a right or left step with the equal proba- 
bility of a half. For 7 = the model is exactly same with 
the noise- free MBR. In the other limit, for 7 = 1, the 
randomizing process dominates and the system reduces 
to a simple unbiased random walk where the net current 
remains zero. It is important to note that 7 influences 
the level of noise in the ratchet but is not identical with 
the noise itself. We refer to 7 as a 'noise parameter'. 
With this modification the transition probability matrix 
B changes as 



[Bi, 



7p + 7/2 JPo +7/2 
7P1+7/2 7P1+7/2 
IP2 + 7/2 IP2 + 7/2 



From the transition matrix, we know that adding the 
random noise with parameter 7 effectively changes the 
existing parameters as 



Pk 



IPk +7/2 



(8) 



and same holds for the pit's. The steady state solution 
and net current for noisy MBR can be obtained by ex- 
changing all the pfe's in Eqs. 01 and according to Eq. |S1 
The expression for current is given as 



J 7 = {fA_ 



7(7/2)(l -7/2)£]M 



where 



D 1 = 2 + fA+ + 7(7/2) (I + 7/2) 
A± = P0P1P2 ± P0P1P2 
B = P0+P1+P2-P0- Pi - P2- 



(9) 



(10) 



It is possible to further restrict the choices of 
{Po,PiiP2} without losing the important properties of 
the ratchet. Parrondo's original definition imposed the 
further constraints pa = q and p\ = P2 = p. This re- 
duced the parameter space to a two dimensional space 
with parameters {p, q}. In two dimensional {p, q} param- 
eter space, the condition of detailed balance, i.e., Eq. 
gives the equation for a curve that we call the null-curve: 



P 2 



{l-pf 



p2 _|_ p2 p 2 + (1 — p) 2 



(11) 



The null-curve is a special case of the more general null- 
surface or null-hypersurface, in higher dimensions. Fig. [21 
shows the 'positive' and 'negative' net current regions 
of the noise-free MBR. Note that as expected from the 
symmetry of the system the curve is invariant under the 
transformations q — > (1 — q) and p — > (1 — p). This also 
apparent from a consideration of Eq. 
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FIG. 2: The null-surface of a 3-state discrete-time Brownian 
ratchet. On the null-surface, q — (1 — p) 2 /(p 2 + (1 — p) 2 ), the 
current vanishes. Above the curve, the system has positive 
net current. Below the curve, the system has negative net 
current. 



On the null-surface, we introduce additional random 
noise to the system by controlling the value of 7. For 
7 = the model is exactly same as the noise-free MBR 
and the net current remains zero since we are on the null- 
surface. In the other limit, for 7 = 1, the randomizing 
process dominates and the system reduces to a simple 
unbiased random walk where the net current is also zero. 
However, counter-intuitively, for < 7 < 1 non-zero cur- 
rent is induced by introducing random noise controlled 
by 7. 

In Fig. we show the current versus noise parameter, 
7, for different values of parameters p and q = p 2 / 1 (p 2 + 
p 2 ). As 7 is increased from zero, the current increases 
to a maximum and then falls off, which has the form of 
stochastic resonance |2l| . The position of this extremum 
can be obtained from the condition, dl-y/d"f = 0. 7 varies 
a little from 0.408 for p = 0.1 to 0.423 for p = 0.5. 

Fig. ^ shows the net current, 7 7 , versus noise 7 when 
the system is not on the null-surface any more. In the 
off-balance region, q ^ p 2 /(p 2 + p 2 ), the net current is 
not zero for 7 = but still should be zero for 7=1 and 
the intermediate behavior is qualitatively the same as the 
balanced behavior. The actual values of p and q for the 
various curves in Fig. 0] are in linear increments of 0.01 
for p and q. The top curve has parameters p = 0.77 and 
q = 0.12. The bottom curve has parameters p = 0.73 
and q = 0.08. 

We generalize the MBR by introducing a bias into the 
added noise. The walker takes a right step with proba- 
bility of 0.5 — e and a left step with probability of 0.5 + e. 
For e ^ this noise introduces non-zero net current. The 
new parameter, e, is essentially a measure of the bias in 
the added noise. 
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FIG. 3: The probability current, 7 7 , versus noise parameter, 
7, on the null-surface. For values of p 7^ 0.5, additional noise 
induces a net current that increases, in magnitude, with in- 
creasing 7 and then decreases, in magnitude, to zero after 7 
exceeds an optimum value. The bottom curve corresponds 
to p — 0.1. All the other curves represent increments of 
Ap = 0.1. The middle curve corresponds to p = 0.5. The 
top curve corresponds to p = 0.9. Parrondo's original games 
had p = 0.75. 
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FIG. 4: The probability current 7 7 , versus noise parameter, 
7, off the null-surface. The bottom curve corresponds to p = 
0.73 and q = 0.08 and the top to p = 0.77 and q = 0.12. 



We can generalize this model to a system of size N 
by repeating the unit cell of modulo-3 N times with a 
periodic boundary condition. In this case, the periodic 
potential ensures Pk(t) = Pk+3n (t)Vn = 0,±1,±2, ••• . 
Because of the normalization condition, X)fe=i Pk(t) = 1, 
the current will be reduced by factor of TV". Otherwise, the 
corresponding master equations and solutions are exactly 
same as the minimal model. 
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For different moduli, in principle, we can also set up 
the master equations and solve them exactly by matrix 
inversion for the set of linear equations. It can be shown 
that these results have qualitatively the same statistical 
behavior as the 3-state MBR. Note that for even number 
moduli there are oscillatory non-stationary solutions. 

The transformation in Eq.|S]tells us effectively that the 
MBR gives the same results as a biased random walk, 
where the transition probability is not symmetric but bi- 
ased. Although this analogy can be used to investigate 
the characteristics of MBR, it is absolutely impossible to 
determine whether the system is itself a biased random 



walk or an MBR by analyzing the result of measurements, 
without prior knowledge that the model is a combination 
of a balanced unbiased random walk and added random 
external noise. This makes the MBR valuable for under- 
standing the minimal features of the discrete-time Brow- 
nian ratchet. The MBR has applicability in discrete-time 
processes where the transition probabilities do not fluc- 
tuate in time, such as in game and computation theory 
where transitions occur at precisely defined times. 
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